个人信息
参与实验室科研项目
学术成果
共撰写/参与撰写专利 0 项，录用/发表论文 2 篇，投出待录用论文3篇。
Journal Articles
-
Neuronal Attention Circuit (NAC) for Representation Learning
Waleed Razzaq,
and Yun-Bo Zhao
Neural Networks
2027
[Abs]
[doi]
[pdf]
Attention improves representation learning over RNNs, but its discrete nature limits continuous-time (CT) modeling. We introduce Neuronal Attention Circuit (NAC), a novel, biologically inspired CT-attention mechanism that reformulates attention logit computation as the solution to a linear first-order ODE with nonlinear interlinked gates derived from repurposing the wiring of C. elegans Neuronal Circuit Policies (NCPs). NAC replaces dense projections with sparse sensory gates for query-key projections and introduces a sparse backbone network with two heads for computing content-target and learnable time-constant gates, enabling efficient adaptive dynamics. To improve efficiency and memory consumption, we implement an adaptable, sparse, subquadratic Top-K pairwise concatenation mechanism that selectively curates query-key interactions. We provide rigorous theoretical guarantees, including state stability and bounded approximation errors. Empirically, we implement NAC in diverse domains, including irregular time-series, long-range forecasting, lane-keeping for autonomous vehicles, and industrial prognostics. We observe that NAC matches or outperforms in accuracy against several CT state-of-the-art baselines, while being interpretable at the neuron cell level.
-
CARLE: A Hybrid Deep-Shallow Learning Framework for Robust and Explainable RUL Estimation of Rolling Element Bearings
Waleed Razzaq,
and Yun-Bo Zhao
Soft Comput
2025
[Abs]
[doi]
[pdf]
Prognostic health management (PHM) systems have extensive applications in industry for monitoring and predicting the health status of equipment. Remaining Useful Life (RUL) estimation stands out as one important part of a PHM system that predicts the remaining operational lifespan of mechanical systems or their components, such as rolling element bearings, which account for a high proportion of machinery failures. Although many methods for RUL estimation have been developed, there are some challenges in terms of generalizability and robustness under dynamic operating conditions. This paper introduces the CARLE AI framework, which integrates advanced deep learning architectures with shallow machine learning technique to overcome these limitations. CARLE integrates Res-CNN and Res-LSTM blocks with multihead attention and residual connections to capture spatial and temporal degradation trends coupled with Random Forest Regression (RFR) for robust and accurate predictions. We further propose a compact feature extraction framework that implements Gaussian filtering for efficient noise reduction and Continuous Wavelet Transform (CWT) for time–frequency feature extraction. We assessed the effectiveness of the proposed framework via the XJTU-SY and PRONOSTIA bearing datasets. Ablation experiments were conducted to assess the contribution of each component within CARLE, whereas noise experiments evaluated its resilience to noise. Cross-domain validation experiments were performed to examine the model’s generalizability across multiple domains. Additionally, comparative analyses with several state-of-the-art methods under dynamic operating conditions demonstrated that CARLE outperformed competing approaches, particularly in terms of generalizability to unseen scenarios. Furthermore, we discuss the reliability and trustworthiness of this framework via multiple state-of-the-art explainable AI (XAI) techniques, i.e., LIME and SHAP.